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ABSTRACT 

This  note  is  concerned  with  the  regularity  of  solutions  of  algebraic  Riccati  equations 
arising  from  infinite  dimensional  LQR  and  l^QG  control  problems.  We  show  that 
distributed  parameter  systems  described  by  certain  parabolic  partial  differential  equations 
often  have  a  special  structure  that  smoothes  solutions  of  the  corresponding  Riccati 
equation.  This  analysis  is  motivated  by  the  need  to  find  specific  representations  for  Riccati 
operators  that  can  be  used  in  the  development  of  computational  schemes  for  problems 
where  the  input  and  output  operators  are  not  Hilbert-Schmidt.  This  situation  occurs  in 
many  boundary  control  problems  and  in  certain  distributed  control  problems  associated 
with  optimal  sensor/actuator  placement. 
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1.  INTRODUCTION 


In  [LCT],  Lupi,  Chen,  and  Turner  considered  a  distributed  parameter  LQR  prcMon  for  an 
Euler-Bemoulli  beam  model.  Although  this  problem  has  bera  considered  by  several 
peqple  over  the  past  ten  years,  the  ^pioach  in  [LCT]  is  of  interest  in  that  they  make  no 
prior  assumptions  regarding  the  form  of  the  controls/actuators  in  an  effort  to  make 
decisions  abmt  where  actuators  and  sensors  are  best  placed.  In  particular,  in  [LCT]  they 
assumed  that  the  input  operator  was  the  identity.  Miller  and  van  Schoor  [MvS]  also 
considered  the  problem  of  constructing  kernels  for  integral  representaticms  of  fee^adc 
control  laws  obtained  by  solving  LQR  control  problems  for  various  beam  models.  They 
used  these  kernels  to  shape  and  design  area  averaging  polyvinylidene  fluoride  sensors  (a 
type  of  piezoelectric  film).  These  sensors  enable  the  real-time  implementation  of  fiill  state 
feedback  for  the  infinite  dimensional  system  governed  by  the  Euler-Bemoulli  equation 
(also,  see  [MvS]).  As  in  [LCT],  Miller  and  van  Schoor  assumed  the  existence  of  an 
integral  representation  for  the  fe^back  control  law  and  then  proceed  to  "approximate” 
these  kernels  by  using  finite  element  models.  In  both  papers,  fundamental  mathematical 
questions  concerning  the  existence  of  integral  representations  and  the  smoothness  of  the 
corresponding  integral  kernels  are  not  considei^.  These  issues  are  important  in  the 
develc^ment  and  analysis  of  rigorous  numerical  ^proximations.  Also,  the  ability  to 
accurately  compute  these  kernels  is  an  essential  component  in  the  study  of  actuator/sensor 
placement. 

During  the  past  ten  years  considerable  effort  has  been  devoted  to  the  study  of  Riccati 
equations  associated  with  LQR  and  LQG  control  of  distributed  parameter  systems  in 
Hilbert  spaces.  In  the  recent  papers  by  Rosen  ([Rl],  [R2])  and  De  Santis,  Germani  and 
Jetto  [DGJ]  it  was  shown  that,  under  suitable  assumptions  on  the  system  input,  output  and 
weighting  operators,  that  the  Riccati  operator  is  Hilbert-Schmidt.  This  observation  made 
it  possible  to  develop  an  approximation  theory  in  the  space  of  Hilbert-Schmidt  operators 
and,  as  noted  in  [DGJ],  the  smoothness  action  of  Hilbert-Schmidt  operators  can  be 
exploited  to  relax  the  hypothesis  that  approximation  schemes  converge  to  the  dual 
semigroup.  In  addition,  if  the  Riccati  operator  is  Hilbert-Schmidt,  then  one  has  explidt 
representation  theorems  that  can  be  used  to  analyze  the  convergence  of  numerical 
approximations. 

The  papers  noted  above  represent  two  basic  ^proaches  to  the  problem.  Rosen  [Rl] 
considered  the  problem  for  control  systems  where  the  generator  of  the  semigroup  was 
strongly  coercive  and  developed  a  theory  for  this  restricted  class  of  systems.  In  [DGJ]  the 
approach  was  to  consider  general  dynamical  systems  (not  necessarily  analytic  semigroups), 
and  then  require  that  certain  system  operators  (input,  weighting,  etc.)  be  nuclear.  The 
problem  we  consider  in  this  short  note  lies  between  these  two  ^roaches,  although  it  is 
more  in  the  spirit  of  Rosen  [Rl].  We  extend  Rosen's  results  to  control  systems  governed 
by  parabolic  equations  without  requiring  that  the  other  system  operators  be  Hilbert- 
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Schmidt.  Indeed,  the  results  below  r^iply  to  a  large  class  of  control  problems  with 
unbounded  input  operators.  In  order  to  focus  the  discussion  we  consider  mily  the  IjQR 
problem.  However,  the  ideas  and  methods  extend  to  LQG  and  MinMax  control  problems. 


2.  THE  PROBLEM  DESCRIPTION 

Consider  the  control  system 

(2.1)  x(t)  -  Ax(t)  +  Bi<r),  x(0)  -  Xo 
with  controlled  output 

(2.2)  z(t)-Cx(t) 
and  cost  function 


^  0 

If  Q  =  C*C,  then  J  becomes 

(2.3)  m  -  iJ{(ex(().x(o)+w<),B(<)»<*, 

^  0 

where  the  state  weighting  matrix  Q  is  self-adjoint  and  non-negative  definite.  Although  it  is 
possible  to  consider  more  general  systems  or  the  case  with  Q  unbounded  and  B  bounded, 
we  limit  our  discussion  to  systems  satisfying  the  following  standing  hypothesis: 


(H)  The  spaces  X,  Z  and  U  are  separable  Hilbert  spaces  and; 

(i)  The  linear  operator  A  is  the  generator  of  a  CQ-semigroup  S(t)  on  X  and  there 
exist  M>  0,ta  >  0  such  that  |fS(r)|  s  Afe'"'. 

(ii)  The  operator  C:X  -*  Z  is  a  bounded  linear  operator  from  X  to  Z. 

(Hi)  The  (possibly  unbounded)  linear  operator  B  maps  U  into  X  and  B:U  -* 
[Dom(A*)]’.  Moreover,  there  exists  a  gamma  with  0  ^  y  < 

L(U,X). 
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(iv)  ForeadiXQE  X there  emts a  control u(.)  S  L^0,»  ;U)  suchAatthe 
functional  J(u)  in  (2.3)  is  finite. 


When  the  optimal  control  exists,  it  is  given  in  feedback  form 

(2.4)  -  -B'Px^(t)  -  -Kxjit), 

where  P  is  the  non-negative  definite  soluticm  to  the  algebraic  Riccati  equation  (ARE) 

(2.5)  (Px,Ay),  *  {Ax,Py),  -  {B‘Fx,B'Py)^  *  (Cx.Cy),  -  0 
for  all  X,  y  in  Dom(A). 

In  [Rl],  R2],  [DGJ]  and  [GJP]  it  is  assumed  that  C  and  B  are  bounded  linear  operators. 
Rosen  [Rl]  assumes  that  A  is  strongly  coercive,  PBB*P  is  Hilbert-Schmidt  whenevn  P  is 
Hilbert'Schmidt  and  that  Q  is  Hilbert-Schmidt.  On  the  other  hand,  De  Santis,  German! 
and  Jetto  [DGJ]  make  no  additional  assumptions  on  A,  but  require  that  C  be  Hilbert- 
Schmidt  and  B  be  bounded  fi’om  U  to  X.  The  assumption  that  C  be  Hilbert-Schmidt 
implies  that  the  weighting  operator  Q  =  C*C  is  nuclear.  Hence,  the  assumption  on  Q  in 
[DGJ]  is  stronger  than  the  corresponding  condition  in  [Rl].  The  two  problems  are  not 
mutually  exclusive  and,  as  one  mi^t  expect,  there  is  no  unified  theory.  In  this  paper  we 
consider  problems  with  B  unbounded  and  Q  not  Hilbert-Schmidt.  Unbounded  B 
operators  allow  us  to  treat  certain  boundary  control  problems  and  problems  with 
piezoelectric  actuators/sensors.  Also,  the  case  where  C  -  B  (the  identity  on  X)  arises 
naturally  in  the  solution  of  optimal  sensor/actuator  location  problems  (see  [BKl],  [KM] 
and  [LCT]). 

We  consider  here  the  case  where  A  generates  an  analytic  semigroup.  The  following 
theorem  may  be  found  in  [LT]. 


Theorem  2.1  Assume  that  hypothesis  (H)  holds.  If  A  generates  an  analytic  semigroup, 
then  there  exists  a  self-adjoint,  non-negative  definite  bounded  linear  operator  P  -  P* 
that  solves  the  ARE  (2.5).  Moreover; 

(a)  For  each  e  >  0,  the  operator  [A*]‘’*P  belongs  to  L(X,X). 

(b)  If  A  is  self-adjoint,  normal  or  has  a  Riesz  basis  of  eigenvectors,  then  e  can 
be  taken  to  be  0. 

(c)  The  operator  B*P  belongs  to  L(X,  U). 
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Observe  that  if  A  has  a  compact  resolvent,  then  P  is  compact.  In  general  it  is  not  possible 
to  conclude  that  P  has  additional  smoothing  properties  unless  more  is  known  atout  the 
operators  A,  B  and  C  Consider  the  following  example: 

Example  2.2  Let  X  =  Z  s  U  s  L2(0,l)  and  set  A  =  C  =  I.  If  B  =  -J%\,  then  P  =  I  is  the 
unique  positive-definite  solution  to  the  ARE  (2.5).  Hypothesis  (H)  holds  and  A  generates 
an  analytic  semigroup.  However,  P  is  not  compact. 

In  certain  spedfic  cases  it  is  possible  to  obtain  additional  information  about  the  regularity 
of  the  Riccati  operator  P.  In  the  next  section  we  consider  a  parabolic  control  problem 
similar  to  the  one  treated  by  Rosen  (see  [Rl],  [R2])  and  use  classical  representation  theory 
to  show  that  P  is  Hilbert-Schmidt.  This  partioilar  approach  not  only  yields  very  precise 
information  about  the  smoothness  of  P,  it  leads  to  a  rather  simple  proof. 


3.  A  PARABOLIC  CONTROL  PROBLEM 

In  order  to  keep  the  present  paper  short  we  shall  limit  our  discussion  to  a  ID  parabolic 
control  problem.  Although  problems  in  higher  dimensions  can  be  treated  in  a  similar 
fashion  (subject  to  the  Sobolev  imbedding  theorems),  the  analysis  is  more  complex  and 
will  appear  in  a  future  paper. 

We  consider  the  operator  A  defined  on  the  state  space  X  =  L2(0,l)  with  domain 

(3.1)  Dom(A)  - 
and  for  <p  EDom{A) 

(3.2)  M'PKD-^'Pd)- 

In  order  to  simplify  the  proof,  we  begin  with  the  case  where  Z  =  X  =  L2(0,l),  C  -  g  - 

and  B:U - *[Don^A')]'  satisfies  (H)-(iii).  The  extension  to  general  C  operators  and 

unbounded  input  operators  B  satisfying  hypothesis  (H)  is  straightforward.  We  note  that 
if  B  is  bounded  into  X,  then  (H)  is  satisfied. 

The  controlled  heat  equation  is  (see  [Rl],  [R2])  written  as 

(3.3)  ^»<<.|)--^h<<,|)+[Bi<()KIX  oo. 

Ot  de 
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with  boundary  conditions 

(3.4)  M<<,0)-0,  0<t 

and  cost  function 

(3.5) 

*  0  0 

This  problem  has  the  form  (2.1)-(2.3)  and  hypothesis  (H)  holds.  The  operator  A  is  self- 
adjoint  and  generates  an  analytic  semigroup  on  X.  Also,  the  finite  cost  condition  (H)-(iv) 
holds  for  any  B. 

Note  that  Q  is  not  Hilbert-Schmidt  (it  is  not  even  compact).  Therefore,  the  results  in  [Rl] 
and  [DGJ]  do  not  apply  to  this  problem.  However,  we  shall  show  below  that  the  Riccati 
operator  P  is  Hilbert-Schmidt.  Moreover,  the  special  structure  of  the  generator  A  can  be 
exploited  to  obtain  additional  information  about  the  functional  gains.  We  shall  need  the 
following  representation  theorem  which  goes  back  to  Fullerton  in  1946  (see  Theorem  6  on 
page  277  in  [FI]). 


Theorem  3.1  Let  The  a  bounded  linear  operator  mapping  Then 

there  exists  a  function  k{%,t)  such  that  T  has  the  representation 

(3.6)  [7V](i)-|*(l.<)<P(0<*. 

0 

where  the  kernel  k(^,  t)  satisfies  the  following  ajnditions; 

(i)  it(|,OeLj([0,l]x[0,l]). 

(ii)  For  each  §  e  (O.i),  the  mapping  | - >k(^,t)belongs  to  C"[0,l]/or  almost 

all  t  and  for  asm, 

(3-7)  ;^*(|,OeA,a«.i]x(0,iD. 

(iii)  For  each  <p  eL2[0, 1], 

(3,8)  ^\K%‘y^t)<u-\ 

0  0 
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The  following  result  establishes  the  existence  of  an  integral  representation  for  the  Riccati 
operator  and  provides  information  about  the  smoothness  of  the  kernel. 


Theorem  3^  Assume  and  B:U - ►[Z>ow(i4*)]'  satins  (H)-(iU).  IfP  = 

P*  is  the  unique  non-negative  definite  solution  to  the  algebraic  Riccati  equation  (ARE) 
defined  by  the  system  (3.1)-(3.5),  then  P  is  HilbertSdunidt.  Moreover,  there  exists  a 
fimction  k(%,t)  sudt  that P  has  the  representatum 

(3.9) 

0 

where  the  kernel  t)  satisfies  the  following  conditions; 

(1)  k(^,t)  -  ifc(r.|)ec‘([0,i]x[0,i]). 

(2)  For  each  q)eL2[0,ll,  tl>  -  /\p  €  C‘[0,1]  and 

(3.10)  ^^(|).±j  i(|,,)^,)J,.j  Atd.lWO*. 

Proof.  Let  A  be  the  extension  of  A  defined  by  (3.1)  -  (3.2)  to  ^"^[0,1]*  It  follows  fipom 
Theorem  2.1  that  P  and  AP  are  bounded  linear  operators  on  L2(0,l)*  Therefore,  there 
exist  constants  and  C2  such  that  for  all  (pEL2[0,l],  Ptp  Eff^[0,l],  APip  E£2[0,l]  and 

(3.11)  and  |aPp|^  s 

The  space  Dom(A)  -  //*[0,1]  with  graph  norm  is  equivalent  to 

//^[0,1]  (see  [A]).  It  follows  from  the  Sobolev  imbedding  theorem  that 
Dom(A)  -  //^[0,1]  is  continuously  imbedded  in  C*[0,1]  and  hence  there  exists  a  constant 
C3  such  that  for  all  xp  Eff^[0,l] 

(bL 

Let  q>E£2[0,l]  and  ip  •  P«pE//^[0,l].  Then, 

and  it  follows  from  (3.11)  that 
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I^lc*  *  ^  *  ^jJlbLa- 

Consequently,  P  is  a  bounded  linear  operator  from  ^'[0,1]-  Applying 

Theorem  3.1,  yields  the  representation  (3.9). 

Since  P  =  P*  the  kernel  ik(|,0  satisfies  ik(^,r)-A:(r,|).  It  follows  from  part  (ii)  of 
Theorem  3.1  that  it(|,r)  -  ifc(r,|)EC‘([0,l]x  [0,1])  and  (3.10)  is  a  consequence  of  part 

(iii)  of  Theorem  3.1.  Finally,  (see  page  210  in  [RS])  the  operator  P:L2[0,1] - ►L2[0,l] 

is  Hilbert-Schmidt  since  it  has  the  representation  (2.9)  with  k(%,t)  EL2([0,1]  x[0,l]). 

Corollary  3  J  Assume  A  is  defined  by  (3.1)-(3,2),  C~Q~I^  and  B:U - ►L2[0,l]  is 

bounded.  IfP  =  P*  is  the  unique  non-negative  definite  solution  to  the  algebraic  Riccati 
equation  (ARE)  defined  by  the  system  (3.1)-(3.5),  then  the  gain  operator  K  -  -B'P  is 
Hilbert-Schmidt. 


Remark  3.4  Observe  that  if  A  is  defined  by  (3,l)-(3.2),  then  the  proof  given  above  goes 

through  without  change  for  any  bounded  C:L2[0»1] - ®*td  B  satisfying  (H).  In 

particular,  there  is  no  need  to  assume  that  C  (or  B)  is  Hilbert-Schmidt  (see  [Rl],  [DGJ] 
and  [GJP])  and  B  can  be  unbounded.  Also,  as  noted  above,  similar  results  (weaker)  are 
valid  for  2D  and  3D  problems.  Let  Q  denote  a  smooth  bounded  domain  in  R“,  n  s  3,  with 
boundary  F.  Although  for  each  6  >  0  the  imbedding  H^(Q) - - ►C°(Q) 


is  valid,  the  imbedding  ^‘*"(Q) 


C‘(Q)  holds  only  for  m  > 


n 

T 


Hence,  one  would 


expect  less  smoothness  for  /i  >  1  .  These  issues  will  be  addressed  in  a  future  paper. 


4.  NUMERICAL  RESULTS  AND  CONCLUDING  REMARKS 


In  this  section  we  present  some  numerical  results  to  demonstrate  the  role  that  the  operator 
B  plays  on  the  smoothness  of  the  operator  P.  We  conducted  several  experiments  for  the 
operators  where  p  - -1/2,  0,  1/4,  1/2,  3/4,  and  1.  Note  that  if  p  <  1, 

then  hypothesis  (H)  is  satisfied.  When  P  -  0,  B^Ij^  and  B  -  [-A  is  compact.  We 

selected  this  collection  of  B  operators  because  as  p - ►!  the  operator 

A‘‘B  -  A'W  -  in  condition  (H)-(iii)  becomes  "less  smooth".  Observe  that  if  P  - 1, 
then  (H)-(iii)  is  not  satisfied  for  any  y  <  1. 

We  use  standard  linear  finite  elements  to  compute  k"(%,t)-k(%,t),  the  order 
approximation"  of  the  kernel  k(%,t)  .  Figure  4.1  and  Figure  4.2  show  the  N  =  4, 8, 16  and 
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32  finite  element  ^proximations  of  ik(|,0  for  the  cases  and 

respectively.  Observe  the  fast  convergence  »A:(|,r)  and,  as  implied  by 

Theorem  3.2,  the  kernel  k{%,t)  is  smooth.  Figure  4.3,  Figure  4.4  and  Figure  4.5  contain 
analogous  plots  for  where  P-  1/4,  1/2  and  3/4,  respectively.  It  is 

interesting  to  note  that  as  p - the  kernels  k(%,t)  become  less  smooth.  Moreover, 

when  p-1  Theorem  3.2  breaks  down  and  k"{^,t)  appears  to  be  converging  to  a 

"singular  measure"  concentrated  on  the  line  Similar  results  were  observed  for 

weakly  damped  hyperbolic  problems  in  [BKl]  and  for  beam  equations  in  [IXT]. 

As  noted  in  Corollary  3.4,  when  A  is  defined  by  (3.1)-(3.2),  C  =  g  -  /^  and 

B:U - bounded,  then  the  gain  operator  K -  -B’P  is  Hilbert-Schmidt.  In 

some  cases  (e.g.  f7-Z.2[Q']  where  [0,1])  it  is  possible  to  obtain  explicit  integral 
representations  of  -B'P.  The  case  where  B  is  unbounded  requires  additional 
analysis.  Finally,  the  authors  wish  to  thank  J.S.  Gibson  for  Example  2.2  and  several 
helpful  comments. 
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